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Abstract 

We study a new method for detecting non-universal gauge bosons Z' via con- 
sidering their effects on rare top decays. We calculate the contributions of the non- 
universal gauge bosons Z' predicted by topcolor-assisted technicolor (TC2) models 
and flavor-universal TC2 models on the rare top decays t — > cV{V = 3,7, Z) and 
t — > clilj{li, Ij = r, yU, or e). We show that the branching ratios of these processes 
can be significantly enhanced. Over a sizable region of the parameter space, we 
have Br{t — > eg) ~ 10~^ and Br{t — > ctt) ~ 10"'', which may approach the 
observable threshold of near future experiments. Non-universal gauge bosons Z' 
may be detected via the rare top decay processes at the top-quark factories such as 
the CERN LHC. 
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There are many models beyond the standard model (SM) predicting the existence 
of extra U{1) gauge bosons Z' . If discovered they would represent irrefutable proof of 
new physics, most likely that the SM gauge groups must be extended PJ. If these ex- 
tensions are associated with flavor symmetry breaking, the gauge interactions will not 
be flavor- universal i2j, which predict the existence of non-universal gauge bosons Z'. 
After the mass diagonalization from the flavor eigenbasis into the mass eigenbasis, the 
non-universal gauge interactions result in the tree-level flavor-changing neutral current 
(FCNC) vertices of the non-universal gauge bosons Z'. Hence, Z' may have significant 
contributions to some FCNC processes. If these effects are indeed detected at LHC, LC 
or other experiments, it will be helpful to identify the gauge bosons Z', and therefore 
unravel underlying theory 

In the SM, due to the GIM mechanism, rare top decays induced by FCNC are absent 
at tree-level and extremely small at loop levels. In some new physics models beyond the 
SM, rare top decays may be significantly enhanced Thus, rare top decays provide a 
very sensitive probe of physics beyond the SM. Detection of rare top decays at visible 
levels by any of the future colliders would be instant evidence of new physics. Searching 
for rare top decays is one of the major goals of the next generation of high energy collider 
experiments, such as the Tevatron Run II and the CERN LHC. 

The rare top decays have been extensively studied in the context of the SM and 
beyond [S1~[H1- It has been shown that the SM predictions for rare top decays are far 
below the feasible experimental possibilities at present or future collider experiments and 
some models beyond the SM can enhance them by several orders to make them approach 
the observable threshold of near-future experiments. The aim of this paper is to show 
that the non-universal gauge bosons Z' predicted by top color-assisted technicolor (TC2) 
models and flavor-universal TC2 models [10| can give significant contributions to the 
rare top decays t — > cViV = (7, 7 or Z) and t — > dilj{li, Ij = r, /i, or e). With reasonable 
values of the parameters, the value of Br(t — > eg) can reach 5.1 x 10^^. For the branching 
ratio Br(t — > err), it is possible to reach 6.4 x 10^^. Thus, rare top decays may be used 
to detect non-universal gauge bosons Z' in near future experiments. 
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A common feature of TC2 models 9J and flavor-universal TC2 models |10| is that a 
large part of the top quark mass is dynamically generated by topcolor interactions at a 
scale of order ITeV. To ensure that the top quark condenses and receives a large mass 
while the bottom quark does not, a non-universal extended hypercharge gauge group 
f/(l) is often invoked, so that the topcolor gauge group is usually taken to be a strong 
coupled SU (3) x f/(l). Breaking of the extended gauge groups to their diagonal subgroups 
produces non-universal massive gauge bosons. Thus, TC2 models and flavor-universal 
TC2 models all predict the existence of the non-universal gauge bosons Z'. These new 
particles treat the third generation fermions differently from those in the first and second 
generations. So, they can lead to FC couplings. 

The flavor- diagonal couplings of Z' to ordinary fermions, which are related to our 
calculations, can be written as [TT]: 

C^P = g,cote'Z'^[i^hrtL + liRYtn) 

-tanH'ihiLl^eL + e^T^e^)], (1) 

where gi is the hypercharge gauge coupling constant, 6' is the mixing angle with tanO' = 
Qi/ y/Airki. To obtain the top quark condensation and not form a bb condensation, there 
must be tan6' << 1 [HI Elj. The FC couplings of Z' to ordinary fermions, which are 
related to rare top decays, can be written as: 

/:fF = -^g,Kt,Z'^{hrcL + iiRj^cn) 
~^g^Z'^[Kr^{fLYf^L + 2fRYrR) 

+tan'9'K^, {fiLl^eL + ^Plr^^cr)], (2) 
where Ktc and Kij are the flavor mixing factors. 
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From Eq.(l) and Eq.(2) we can see that the rare top decays t — > cV and t — > clilj 
can be generated via Z' exchange in TC2 models and flavor-universal TC2 models. We 
first consider the rare top decay processes t — > cV{V = g,'y, or Z). These processes are 
induced by penguin diagrams. The calculations are straightforward but tedious. Similarly 
Feynman diagrams for contributions of the neutral scalars to t — > cV and t — > ch have 
been calculated in Ref. [6J. Here we do not present the lengthy formulas which are 
expressed in terms of two- and three- point standard Feynman integrals. 
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Figure 1: Branching ratios Br(t — > cV) as functions of the gauge bosons Z' mass M^/ 

for the flavor mixing factor Ktc = A = 0.22. 

Our numerical results are summarized in Fig.l and Fig. 2. In Fig.l, we have assumed 

Kfc = A, which A = 0.22 is the Wolfenstein parameter jT^j. The limits on the mass 

of the extra U{1) gauge bosons Z' can be obtained via studying their effects on various 

experimental observables |^. For example, Ref. [2j studied the bound placed by the 

electroweak measurement data on the Z' mass Mz'- They find that Z' predicted by TC2 

models and fiavor-universal TC2 models must be heavier than about ITeV. As estimation 

the contributions of Z' to the rare top decays, we have taken the Z' mass Mz' as a free 

parameter in Fig.l and Fig. 2. One can see from Fig.l that the branching ratio is sensitive 

to the Z' mass Mz' and suppressed by large Mz'- For ITeV < Mz' < 2TeV, the values of 

the branching ratios Br{t — > eg), Br{t — > 07), and Br{t — > cZ) vary in the ranges of 

1.6 X 10-6 ~ 1.2 X 10-^ 1.7 X 10"^ ~ 1.3 x 10-^ and 8.5 x 10"^ ~ 6.7 x 10-^ respectively. 
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Figure 2: Branching ratios Br{t — > cV) as functions of kfc for M^/ = 1.5TeV. 

To see the effects of the flavor mixing factor Kfc on the branching ratios Br{t — > cV), 
we plot Br(t — > cV) as functions of Ktc for Mz> = 1.5TeV in Fig.2. One can see from 
Fig.2 that the values of Br{t — > cg)[Br{t — >• cy)] can reach 5.1 x 10"^ [5.3 x 10"^] for 
Mz' = 1.5TeV and Ktc = 0.8. 

The LHC sensitivity to the top quark anomalous couplings Kfg and Ktg, which come 
from the effects of new physics, can be obtained by studying quark-gluon fusion, single top 
quark production, t + 'y{Z) production, and like-sign top-pair final states, separately. The 
relevant results are summarized in Ref. If we assume that the anomalous coupling 

vertexes icV come from the non- universal gauge bosons Z', the contributions of Z' to 
the branching ratios Br{t — > cV) can be transposed to those of Z' to the top quark 
anomalous couplings Kf^ and Ktg. For example, the value of the anomalous coupling Kf^ 
can reach 6.8 x 10^'^ for Mz> = 1.5TeV and Ktc = 0.8. Hence, we can conclude that, if 
non-universal gauge bosons Z' are not too heavy and can induce large FC couplings, the 
possible signals of these new particles may be detected via the FCNC processes t — > cV 
at the top quark factories such as the CERN LHC. 

The non-universal gauge bosons Z' can induce the tree-level FC couplings at quark 
and lepton sector. Thus, the rare top decays t — > cklj can be generated at tree-level or 
at one-loop only for i = j. However, the contributions of Z' to the processes t — > clilj 
via the off-shell photon pengiun and Z pengiun diagrams are only at the order of the 
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Figure 3: Branching ratio of the process t — >■ err as a function of the flavor mixing K for 
Mz' = 1.0Te1/(sohd hue) and 1.5Te1/(dashed hne). 

magnitude of 1% of the tree- level result and therefore can be ignored. The conclusion is 
similar to that of the lepton flavor- violation tau decays r — > hljlk jl4j . 

In the context of TC2 models and flavor-universal TC2 models, the non-universal 
gauge bosons Z' only treat the fermions in the third generation differently from those 
in the flrst and second generation and treat the fermions in the flrst generation same as 
those in the second generation. Thus, there must be Br{t — > cfi^) = Br{t — > cee) and 
Br{t — y CTfi) = Br{t — > ere) for assuming Kr^ = Kre- Compared with the couplings 
of Z' to the third family fermions, the couplings of Z' to the flrst and second family 
fermions are suppressed by the factor tan^O' . It has been shown that the choice ki = 1 
corresponds to tan'^6' ^ 0.01 [llj. Thus, the branching ratio Br{t — > ctt) is about four 
orders of magnitude larger than those of the processes t — > cfifi and t — > cee. 

In Fig. 3 and Fig. 4 we plot branching ratios Br(t — > ctt) and Br(t — > ct^) as 
functions of the flavor mixing factor K. We have assumed in Fig. 3 and Fig. 4 that the 
flavor mixing factor in quark sector is equal to that in lepton sector i.e. Ktc = = K. 
One can see that the value of Br{t — > ctt) is larger than that of Br{t — cr/i) in all of 
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Figure 4: Same as Fig.3 but for Br{t — > cTfi). 

the parameter space. For Mz' = l.hTeV and 0.1 < isT < ^, there are 2x 10 ^ < Br{t — > 
err) < 9.7 x 10"^ and 2 x 10^^^ < ^^^^ — , ^^^^ < 4 3 ^ 10"9. For Mz' = l.OTeV and 
K = 0.8, it is possible to have Brit — > err) = 6.4 x 10"*^ and Br(t — > crfi) = 4.2 x 10"^. 
Certainly, the values of branching ratios Br{t — > clilj) are strongly dependent on the 
value of the flavor mixing factor K. We expect that this physical parameter can be 
measured in the future experiments and it can give a strong clue about the new physics 
beyond the SM. 

If the top anomalous couplings are present and large enough, the new particles can give 
significantly contributions to single production of top quarks. These have been extensively 
studied at lepton colliders [15J and at hadron colliders JH]- Thus the non-universal gauge 
bosons Z' predicted by TC2 models and flavor- universal TC2 models might give large 
contributions to single production of top quarks. 

To summarize, we have studied the contributions of the non-universal gauge bosons 
Z' predicted by TC2 models and flavor-universal TC2 models to the rare top decays 
t — > cV and t — > clilj. We have shown that the branching ratios of these processes can 
be significantly enhanced. With reasonable values of the parameters, the branching ratio 
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Br(t — > eg) [Br(t — > err)] can reach 5.1 x 10^^ [6.4 x 10^®], which might approach the 
observable threshold of near future experiments. For the branching ratio Br{t — > CTfi), 
it is possible to reach 4.1 x 10~®. The production of 10^ ~ 10® top quark pairs per year 
at the CERN LHC will allow to probe the top couplings to both known and new particles 
involved in possible top decay channels different from the main t — > Wb. On a purely 
statistical basis, one should be able to detect a particular decay channel whenever its 
branching ratio is larger than about 10~^ ~ 10^^ 01 Ej- Hence, the non-universal gauge 
bosons Z' may be detected via rare top decays at the top-quark factories, the CERN 
LHC, as long as their masses are not too heavy. 

Except TC2 models and flavor- universal TC2 models, there are many models beyond 
the SM, such as non-commuting ETC modelsjlS^ and top flavor seesaw models|19,, pre- 
dicting the existence of non-universal gauge bosons Z', which have similar property consid- 
ered in this paper. Therefore, we believe that our conclusion is quite model-independent. 
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